Journal article
Replicability, Robustness, and Reproducibility in Psychological Science
BA Nosek, TE Hardwicke, H Moshontz, A Allard, KS Corker, A Dreber, F Fidler, J Hilgard, M Kline Struhl, MGLB Nuijten, JM Rohrer, F Romero, AM Scheel, LD Scherer, FD Schönbrodt, S Vazire
Annual Review of Psychology | ANNUAL REVIEWS | Published : 2022
Abstract
Replication mdash an important, uncommon, and misunderstood practice mdash is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings..
View full abstractGrants
Awarded by National Science Foundation
Funding Acknowledgements
This work was supported by grants to B.A.N. from Arnold Ventures, the John Templeton Foundation, Templeton World Charity Foundation, and Templeton Religion Trust. T.E.H. received funding from the European Union's Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No. 841188. F.F. is funded by an Australian Research Council Future Fellowship (FT150100297). A.M.S. is currently funded through a grant by the Dutch Research Council (NWO) on "Increasing the Reliability and Efficiency of Psychological Science." L.D.S. has received funding from the National Institutes of Health, the Agency for Healthcare Research and Quality, and the Patient-Centered Outcomes Research Institute. We thank Adam Gill for assistance creating Figures 1 and 2 and Supplemental Figure 2. Data, materials, and code are available at https://osf.io/7np92/.